MusiCam: an instrument to demonstrate chromaphonic synesthesia

نویسندگان

  • Derek Yau
  • Rachel Jane McCrindle
چکیده

Inspired by a type of synesthesia where colour typically induces musical notes the MusiCam project investigates this unusual condition, particularly the transition from colour to sound. MusiCam explores the potential benefits of this idiosyncrasy as a mode of Human Computer Interaction (HCI), providing a host of meaningful applications spanning control, communication and composition. Colour data is interpreted by means of an offthe-shelf webcam, and music is generated in real-time through regular speakers. By making colour based gestures users can actively control the parameters of sounds, compose melodies and motifs or mix multiple tracks on the fly. The system shows great potential as an interactive medium and as a musical controller. The trials conducted to date have produced encouraging results, and only hint at the new possibilities achievable by such a device.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The emotional valence of a conflict: implications from synesthesia

According to some synesthetes' reports, their experience involves an emotional sensation in which a conflict between the photism and presented color of a stimulus may evoke a feeling of discomfort. In order to investigate the impact of this experience on performance, two experiments were carried out on two synesthetes and their matched control groups. Experiments were tailored for each synesthe...

متن کامل

Enhanced Cortical Excitability in Grapheme-Color Synesthesia and Its Modulation

Synesthesia is an unusual condition characterized by the over-binding of two or more features and the concomitant automatic and conscious experience of atypical, ancillary images or perceptions. Previous research suggests that synesthetes display enhanced modality-specific perceptual processing, but it remains unclear whether enhanced processing contributes to conscious awareness of color photi...

متن کامل

Synesthetic experiences enhance unconscious learning.

Synesthesia  is characterized  by consistent extra perceptual experiences in response to normal sensory input. Recent studies provide evidence for a specific profile of enhanced memory performance in synesthesia, but focus exclusively on explicit memory paradigms for which the learned content is consciously accessible. In this study, for the first time, we demonstrate with an implicit memory pa...

متن کامل

A standardized test battery for the study of synesthesia.

Synesthesia is an unusual condition in which stimulation of one modality evokes sensation or experience in another modality. Although discussed in the literature well over a century ago, synesthesia slipped out of the scientific spotlight for decades because of the difficulty in verifying and quantifying private perceptual experiences. In recent years, the study of synesthesia has enjoyed a ren...

متن کامل

When "3" is a Jerk and "E" is a King: Personifying Inanimate Objects in Synesthesia

We report a case study of an individual (TE) for whom inanimate objects, such as letters, numbers, simple shapes, and even furniture, are experienced as having rich and detailed personalities. TE reports that her object-personality pairings are stable over time, occur independent of her intentions, and have been there for as long as she can remember. In these respects, her experiences are indic...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Digital Creativity

دوره 18  شماره 

صفحات  -

تاریخ انتشار 2007